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DETAILED ACTION 

Continued Examination Under 37 CFR 1.114 

1 . A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1 .17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 14 
March 2008 has been entered. Claims 1-32 are pending. 

Response to Arguments 

2. Applicant's arguments with respect to claims 1-31 have been considered but are 
moot in view of the new ground(s) of rejection. 

3. Applicant's arguments filed with respect to the 112, 1 st paragraph rejection of 
claim 32 have been fully considered but they are not persuasive. 

In the response filed 14 March 2008, there are no arguments pertaining to the 
1 12, 1 st paragraph rejection of claim 32, and as such the rejection is maintained. 
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Claim Objections 

4. Claim 27 is objected to because the specification fails to provide antecedent 
basis for the claim terminology "computer readable storage". 

Claim Rejections - 35 USC §112 

5. The following is a quotation of the first paragraph of 35 U.S.C. 1 12: 

The specification shall contain a written description of the invention, and of the manner and process of 
making and using it, in such full, clear, concise, and exact terms as to enable any person skilled in the 
art to which it pertains, or with which it is most nearly connected, to make and use the same and shall 
set forth the best mode contemplated by the inventor of carrying out his invention. 

6. Claim 32 is rejected under 35 U.S.C. 112, first paragraph, as failing to comply 
with the written description requirement. The claim(s) contains subject matter which 
was not described in the specification in such a way as to reasonably convey to one 
skilled in the relevant art that the inventor(s), at the time the application was filed, had 
possession of the claimed invention. 

Claim 32 states "a first graphical user interface located responsive to a natural 
motion by a user associated with a first end of a range of the natural motion; and 
second graphical user interface located responsive to the natural motion by a user 
associated with a second end of the range of the natural motion; and said first and 
second graphical user interfaces each comprising: an arc shaped persistent graphic 
defining the interface area where the arc is substantially perpendicular to a natural 
motion path of the natural motion; and controls initiating an action, located in the 
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interface area and accessible via the natural motion" which is not described in the 
specification. The specification only shows one interface menu located at an end range 
of a user motion that is perpendicular to the motion arc. The specification does not have 
support for a second menu being located at the other end also being perpendicular. The 
specification explains of a pop-up circular menu, however, this menu is not at the other 
end of the user motion range. The specification also explains of an overflow menu being 
located on the natural motion arc, however, this menu is not perpendicular to the natural 
motion arc. Thus, the specification does not contain support for the limitations of claim 
32. 



Claim Rejections - 35 USC § 103 



7. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

8. The factual inquiries set forth in Graham v. John Deere Co., 383 U.S. 1 , 148 
USPQ 459 (1966), that are applied for establishing a background for determining 
obviousness under 35 U.S.C. 103(a) are summarized as follows: 

1 . Determining the scope and contents of the prior art. 

2. Ascertaining the differences between the prior art and the claims at issue. 

3. Resolving the level of ordinary skill in the pertinent art. 
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4. Considering objective evidence present in the application indicating 
obviousness or nonobviousness. 

9. Claims 1-9, 11-14, 20-21, 23-24, 27-29 and 31 are rejected under 35 U.S.C. 
103(a) as being unpatentable over Pitroda (US 2002/0097277) in view of Miyashita et 
al. (US 2002/0122158) and further in view of Selker (US 2002/0122072). 

Regarding claim 1, Pitroda discloses an interface, comprising: 
a graphical user interface area located in a display corner responsive to a natural 
motion by a user associated with an end of a range of the natural motion (Figure 1 1 A 
shows a graphical user interface area located in the upper left corner which is 
responsive to the end range of a natural motion of a user that is left handed.) and, 
comprising: 

an arc shaped graphic starting near a first display edge and ending near a 
second display edge and defining the interface area where the arc is substantially 
perpendicular to a natural motion path of the natural motion (Figure 1 1A shows a 
graphical user interface area located in the upper left corner that has an arc shaped 
graphic which starts near the left display edge and ends near the upper display edge, 
where if a user is left handed, then the interface graphic would be associated with and 
perpendicular to their natural motion path.); and 

controls initiating an action located in the interface area and accessible via the 
natural motion (Figure 1 1 A shows that there are controls labeled "primary universe" 
located in the interface area which are accessible via the natural motion path of a left 
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handed user, where paragraph [0133] explains that the "primary universes" initiate an 
action when selected [changes the display to show child universes of the selected 
primary universe].). 

Pitroda fails to teach wherein the graphical user interface area is located in a 
lower display corner. 

Miyashita et al. disclose of an interface comprising a graphical user interface 
area located in a lower display corner (Figures 18 and 19 and paragraph [0141]). 

Therefore, it would have been obvious to "one of ordinary skill" in the art at the 
time the invention was made to make the interface taught by Pitroda to be located in a 
lower display corner as taught by Miyashita et al. in order to allow filed to be selected 
without impairing the view of the image data being displayed (Miyashita et al., 
paragraph [0141]). 

Pitroda and Miyashita et al. fail to teach wherein the graphical user interface area 
comprises an arc shaped persistent graphic. 

Selker discloses of an interface comprising a graphical user interface area 
comprises an arc shaped persistent graphic (Paragraph [0046] explains that the menu 
shown in Figure 2 can be fixed, i.e. persistent.). 

Therefore, it would have been obvious to "one of ordinary skill" in the art at the 
time the invention was made to make the interface taught by the combination of Pitroda 
and Miyashita et al. persistent as taught by Selker in order to allow for the control 
options to be available to a user at all times, while still not impairing the user's view of 
the display. 
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Regarding claim 2, Pitroda, Miyashita et al. and Selker disclose an interface as 
recited in claim 1 . 

Selker also discloses wherein the natural motion is a curve associated with 
movement of a hand of the user when an elbow of the user is pivoted (When anyone 
places their elbow on a surface, they will produce a natural motion curve, and as 
explained above, paragraph [0046] states "The present invention should not be limited 
by size, shape, position on a computer display, number of levels...". Thus the position 
of the arc shaped menu of Figure 2 could be anywhere on the screen, which covers the 
limitation that the graphical user interface area is located responsive to a natural motion 
by a user associated with an end range of the natural motion, where the natural motion 
is a curve associated with movement of a hand of the user when an elbow of the user is 
pivoted.). 

Regarding claim 3, Pitroda, Miyashita et al. and Selker disclose an interface as 
recited in claim 2. 

Selker also discloses wherein a location responsive to the natural motion of the 
user hand is defined by the natural motion passing through a substantial center area of 
a display area (Paragraph [0046] explains that the position on the display of the menu is 
not limited meaning that the interface could be located somewhere with respect to a 
user's hand passing through a center of the display.). 



Application/Control Number: 10/748,686 Page 8 

Art Unit: 2629 

Regarding claim 4, Pitroda, Miyashita et al. and Selker disclose an interface as 
recited in claim 1 . 

Selker also discloses wherein the natural motion is a curve associated with 
movement of a hand of the user when an elbow of the user is pivoted and one of a wrist 
of the user is rotated and fingers of the user are moved (Please refer to the rejection of 
claim 2, where if the user's entire arm past the elbow is moving then the wrist and 
fingers are moved as well.). 

Regarding claim 5, please refer to the rejection of claim 1 . 

Regarding claim 6, Pitroda, Miyashita et al. and Selker disclose an interface as 
recited in claim 1 . 

Selker also discloses wherein the graphic is a shape corresponding to an arc 
shaped curve and the controls are positioned in accordance with the curve (Figure 2). 

Regarding claim 7, Pitroda, Miyashita et al. and Selker disclose an interface as 
recited in claim 6. 

Selker also disclose wherein a radius of the arc shaped curve is at least a radius 
of a menu of one of the controls (Figure 2). 

Regarding claim 8, Pitroda, Miyashita et al. and Selker disclose an interface as 
recited in claim 6. 
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Selker also discloses wherein a control closest to a display area is positioned 
along the curve at least a radius of a menu of the control from a display edge (Figure 2 
and paragraph [0046]). 

Regarding claim 9, Pitroda, Miyashita et al. and Selker disclose an interface as 
recited in claim 1 . 

Selker also discloses wherein a menu associated with one of the controls has a 
layout responsive to the curve (Figure 2). 

Regarding claim 11, Pitroda, Miyashita et al. and Selker disclose an interface as 
recited in claim 1 . 

Miyashita et al. also disclose wherein the interface is located in a lower left 
corner of a display area (Figures 18 and 19), while Pitroda et al. also disclose the 
controls of the interface are arranged as one of a convex arc across the corner, a 
concave arc across the corner, a line across the corner, an array in the corner, a convex 
corner across the corner, a convex arc with a linear portion across the corner, a 
sectioned pie in the corner, a sectioned pie in the corner and extending across the 
display area, and a rotatable circle intersecting both sides of the corner (Figure 1 1A 
shows that the menu items are located along the arc which is convex across the 
corner.). 
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Regarding claim 12, please refer to the rejection of claim 1 , and furthermore 
Figure 1 1 A of Pitroda shows the control zones labeled in the Figure as "primary 
universe" have a shape responsive to an approach arc, which would be perpendicular to 
a "dominant arc" of a user's natural motion on the display, where Figure 12 of Pitroda 
shows that the "primary universe" controls provide for the "pop-up" of the "secondary 
universe" which is a radius. 

Regarding claim 13, Pitroda, Miyashita et al. and Selker disclose the interface 
as recited in claim 12. 

Selker et al. also disclose wherein the zone shape comprises one of a wedge, a 
curved sides triangle and a curved sided trapezoid (Figure 2). 

Regarding claim 14, Pitroda, Miyashita et al. and Selker disclose the interface 
as recited in claim 1 . 

Pitroda also discloses wherein the zones have non-coincident, dominant arc 
approach paths (Figure 1 1 A shows that each "primary universe" would have a different 
arc approach paths by a user.). 

Regarding claims 20 and 27, please refer to the rejection of claims 1 and 12 
and furthermore if the interface is located with controls as illustrated in the rejection of 
claims 1 and 12, then the controls would have been mapped as such and there would 
be a computer readable storage for controlling the mapping. 
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Regarding claim 21, this claim is rejected under the same rationale as claim 5. 

Regarding claim 23, Pitroda, Miyashita et al. and Selker disclose a method as 
recited in claim 20. 

Pitroda also discloses wherein the mapping maps controls on the arc responsive 
to a function of the controls (Figure 1 1 A shows that the controls are mapped onto the 
arc-shaped menu according to their function, i.e. primary universe, secondary universe, 
etc.). 

Regarding claim 24, Pitroda, Miyashita et al. and Selker disclose a method as 
recited in claim 20. 

Pitroda also discloses the method further comprising minimizing the interface 
responsive to activation of a minimize control (Paragraph [0131] explains that when a 
section of the sphere is selected it is moved to a corner of the display, therefore 
minimizing it.). 

Regarding claim 28, please refer to the rejection of claims 1 , 5 and 1 2, where 
Pitroda shows a display in Figure 11 A, as also shown in Figures 18 and 19 of Miyashita 
et al., and where there is inherently a processor in a computer which will operate the 
display and will position the interface of the display. 
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Regarding claim 29, please refer to the rejection of claim 23 where their 
positioning is inherently performed by the processor. 

Regarding claim 31, please refer to the rejection of claim 1 , and furthermore 
Figure 1 1 A of Pitroda covers the limitation of "an arc shaped display edge intersecting 
menu bar interface graphic". 

1 0. Claims 22, 25 and 30 are rejected under 35 U.S.C. 1 03(a) as being unpatentable 
over Pitroda (US 2002/0097277) in view of Miyashita et al. (US 2002/0122158) and 
further in view of Selker (US 2002/01 22072) and Keely, Jr. et al. (US 6,337,698). 

Regarding claim 22, Pitroda, Miyashita et al. and Selker disclose a method as 
recited in claim 21 . 

Pitroda, Miyashita et al. and Selker fail to teach wherein the corner is lower right 
corner for a left-handed person and a lower left corner for a right-handed person. 

Keely, Jr. et al. disclose a graphical user interface located in a corner of a display 
wherein the corner is lower right corner for a left-handed person and a lower left corner 
for a right-handed person (Figs. 10-12, see col. 6, lines 45-54 and col. 7, lines 7-12, 
where it is clear that the menu goes in the lower right corner for a left-handed person 
and the lower left corner for a right-handed person). 

Therefore, it would have been obvious to "one of ordinary skill" in the art at the 
time the invention was made to made the interface graphic taught by the combination of 
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Pitroda, Miyashita et al. and Selker located in a left corner for a right handed user and a 
right corner for a left handed user as taught by Keely, Jr. et al. in order to allow for the 
maximum comfort of the user in operating the menu. 

Regarding claim 25, Pitroda, Miyashita et al. and Selker disclose a method as 
recited in claim 20. 

Pitroda, Miyashita et al. and Selker fail to teach of displaying a menu upon a 
touch input and allowing a user to select an item of the menu, displaying a menu and 
performing an interaction upon a dwell input, and performing a function upon a stroke 
input 

Keely, Jr. et al. also disclose: 

displaying a menu upon a touch input (see col. 6, lines 54-55) and allowing a 
user to select an item of the menu (Fig. 1 0, shows the path a user takes to select an 
item); 

displaying a menu and performing an interaction upon a dwell input (col. 7, lines 
50-57, where the pen leaving the surface can minimize the menu therefore allowing the 
pen to dwell on the surface allows the user to interactively maintain the display of the 
menu); and 

performing a function upon a stroke input (col. 7, lines 27-30, where the user 
makes a selection via a stroke input). 

Therefore, it would have been obvious to "one of ordinary skill" in the art at the 
time the invention was made to use the inputting method taught by Keely, Jr. et al. with 
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the interface method taught by the combination of Pitroda, Miyashita et al. and Selker in 
order to allow for easy and intuitive user input into the computer system. 



Regarding claim 30, please refer to the rejection of claim 25, where Keely, Jr. et 
al. also disclose an apparatus further comprising a stylus-based input system coupled to 
the processor and the display (col. 3, lines 49-50), and activating the controls 
responsive to a tap of a stylus on one of the controls (see col. 6, lines 54-55). 

11. Claim 10 is rejected under 35 U.S. C. 103(a) as being unpatentable over Pitroda 
(US 2002/0097277) in view of Miyashita et al. (US 2002/0122158) and further in view of 
Selker (US 2002/0122072) and Kurtenbach (US 5,689,667). 

Regarding claim 10, Pitroda, Miyashita et al. and Selker disclose an interface as 
recited in claim 1 . 

Pitroda, Miyashita et al. and Selker fail to explicitly teach a marking menu 
associated with one of the controls having a layout where a downward stroke brings up 
additional tool palettes and/or dialogs. 

Kurtenbach discloses a marking menu associated with one of the controls has a 
layout where a downward stroke brings up additional tool palettes and/or dialogs (see 
col. 3, lines 35-60, where a user can bring up a new sub-menu, which constitutes a 
dialog, by making a stroke towards a menu item but not lifting up the pen). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of the invention to incorporate the teachings of Kurtenbach in the device taught by 
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the combination of Pitroda, Miyashita et al. and Selker to have a commonly known 
method of bringing up an a pop-up menu with a single stroke for allowing additional 
controls of the menu to be utilized. 

12. Claims 15-18 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Pitroda (US 2002/0097277) in view of Miyashita et al. (US 2002/0122158) and further in 
view of Selker (US 2002/01 22072) and Anderson et al. (US 5,828,360). 

Regarding claim 15, please refer to the rejection of claim 1, and furthermore 
Pitroda, Miyashita et al. and Selker fail to teach the controls comprising a tool control 
providing a menu for selecting a drawing tool of the application, and a color control 
providing a menu for selecting paint color applied by a drawing tool of the application. 

Anderson et al. disclose different categories of menu items in an arc-shaped 
menu (Fig. 3) and a menu including a tool control providing a menu for selecting a 
drawing tool of the application and a color control providing a menu for selecting paint 
color applied by a drawing tool of the application (Fig. 3, item 31c, see col. 5 lines 13- 
28, where the menu item 31c provides the sub-menu shown in the figure with the 
different drawing tools and for selecting the color.). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of the invention to incorporate the teachings of Anderson et al. in the menu of 
Pitroda, Miyashita et al. and Selker in order to have different types of menu items in an 
arc-shaped menu in order to add the extra functions provided by the menu items and so 
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that these menu items would be easily accessible to hand movements that a user can 
make and remember easily (see Anderson col. 2, lines 1-3). 

Regarding claim 16, Pitroda, Miyashita et al., Selker and Anderson et al. 
disclose an interface as recited in claim 15. 

Anderson also discloses an interface with a minimize control, an edit control 
providing an undo function (Fig. 3 shows an undo control included in the menu), and 
Keely, Jr. et al. also disclose a page control providing a page change function for 
drawing pages of the application (see col. 8, lines 46-51) and a tool type control and 
providing a menu for selection a tool type of the application (Fig. 8, 74, see col. 5, lines 
53-54, where the select tool is a "tool type" control because it provides options for 
selecting tool types such as cut, copy, and paste). 

However, Pitroda, Miyashita et al., Selker and Anderson et al. fail to teach the 
relative locations of each control as discussed in the claim. However, at the time of the 
invention it would have been obvious to a person of ordinary skill in the art to relocate 
the menu items as described in the claim since such a modification would have only 
involved a mere change in the location of the menu items. Applicants have not 
disclosed that the particular positioning of the menu items solves any stated problem, 
provides any advantage, or used for any particular purpose. Further, a change in 
location is generally recognized as being with the level of ordinary skill in the art, see In 
re Japiske, 86 USPQ 70 (CCPA 1950). Therefore, it would have been obvious to one of 
ordinary skill in the art at the time of the invention to modify the invention of Pitroda, 
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Miyashita et al., Selker and Anderson et al. to obtain the invention as specified in the 
above claim. 

Regarding claim 17, Pitroda, Miyashita et al., Selker and Anderson et al. 
disclose an interface as recited in claim 16. 

Pitroda also discloses wherein the graphic comprises a arc-shaped band (Figure 

11 A). 

Regarding claim 18, Pitroda, Miyashita et al., Selker and Anderson et al. 
disclose an interface as recited in claim 16. 

Anderson et al. also disclose wherein pop-up menus pop-up in association with 
the selected control and at a distance from side and bottom edges of the graphic to 
allow all menu commands to be displayed (Figure 3 shows that the menu 32 pops up 
when 31c is selected which allows all controls to be seen.). 

13. Claim 19 is rejected under 35 U.S.C. 103(a) as being unpatentable over Pitroda 
(US 2002/0097277) in view of Miyashita et al. (US 2002/0122158) and further in view of 
Selker (US 2002/0122072), Anderson et al. (US 5,828,360) and Kurtenbach (US 
5,689,667). 



Regarding claim 19, please refer to the rejection of claims 1 5 and 1 6 and 
furthermore Anderson et al. also disclose different categories of menu items in an arc- 
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shaped menu (Fig. 3) and a menu including a tool control that provides a menu for 
selecting a drawing tool (Fig. 3, item 31c, see col. 5 lines 13-28, where the menu item 
31c provides the sub-menu shown in the figure with the different drawing tools), a 
minimize control (Fig. 3, where the 'miniview' control is a type of minimize control), and 
an undo control (Fig. 3 shows an undo control included in the menu). 

Pitroda, Miyashita et al., Selker and Anderson et al. fail to teach a marking menu 
associated with one of the controls has a layout where a downward stroke brings up 
additional tool palettes and/or dialogs. 

Kurtenbach discloses a marking menu associated with one of the controls has a 
layout where a downward stroke brings up additional tool palettes and/or dialogs (see 
col. 3, lines 35-60, where a user can bring up a new sub-menu, which constitutes a 
dialog, by making a stroke towards a menu item but not lifting up the pen). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of the invention to incorporate the teachings of Anderson et al. and Kurtenback in 
the menu of Pitroda, Miyashita et al., Selker and Anderson et al. in order to have 
different types of menu items in an arc-shaped menu so that these menu items would 
be easily accessible to hand movements that a user can make and remember easily 
(see Anderson col. 2, lines 1-3) and to have a commonly known method of bringing up a 
pop-up menu with a single stroke. 

However, Pitroda, Miyashita et al., Selker and Anderson et al. nor Kurtenbach 
teach the location of the tools relative to each other. However, at the time of the 
invention it would have been obvious to a person of ordinary skill in the art to relocate 
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the menu items as described in the claim since such a modification would have only 
involved a mere change in the location of the menu items. Applicants have not 
disclosed that the particular positioning of the menu items solves any stated problem, 
provides any advantage, or used for any particular purpose. Further, a change in 
location is generally recognized as being with the level of ordinary skill in the art, see In 
re Japiske, 86 USPQ 70 (CCPA 1950). Therefore, it would have been obvious to one of 
ordinary skill in the art at the time of the invention to modify the invention of Pitroda, 
Miyashita et al., Selker, Anderson et al. and Kurtenbach to obtain the invention as 
specified in the above claim. 



Allowable Subject Matter 



14. Claim 26 is allowed. 



1 5. The following is a statement of reasons for allowance: 

Relative to independent claim 26, the major difference between the prior art of 
record (Selker, Pitroda, Keekly, Jr. etal., Ono, Anderson, Kurtenbach and Miyashita et 
al.) and the instant invention, is that said prior art does not teach a method wherein if a 
user is inking from a drawing canvas and the inking crosses into the menu, inking still 
occurs on the canvas. 
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Conclusion 

16. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to STEPHEN G. SHERMAN whose telephone number is 
(571 )272-2941 . The examiner can normally be reached on M-F, 8:00 a.m. - 4:30 p.m.. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Amr Awad can be reached on (571 ) 272-7764. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/Stephen G Sherman/ 
Examiner, Art Unit 2629 

/Amr Awad/ 

Supervisory Patent Examiner, Art Unit 2629 
23 May 2008 



